Search for: All records

The interaction and collaboration between humans and multiple robots represent a novel field of research known as human multirobot systems. Adequately designed systems within this field allow teams composed of both humans and robots to work together effectively on tasks, such as monitoring, exploration, and search and rescue operations. This article presents a deep reinforcement learning-based affective workload allocation controller specifically for multihuman multirobot teams. The proposed controller can dynamically reallocate workloads based on the performance of the operators during collaborative missions with multirobot systems. The operators' performances are evaluated through the scores of a self-reported questionnaire (i.e., subjective measurement) and the results of a deep learning-based cognitive workload prediction algorithm that uses physiological and behavioral data (i.e., objective measurement). To evaluate the effectiveness of the proposed controller, we conduct an exploratory user experiment with various allocation strategies. The user experiment uses a multihuman multirobot CCTV monitoring task as an example and carry out comprehensive real-world experiments with 32 human subjects for both quantitative measurement and qualitative analysis. Our results demonstrate the performance and effectiveness of the proposed controller and highlight the importance of incorporating both subjective and objective measurements of the operators' cognitive workload as well as seeking consent for workload transitions, to enhance the performance of multihuman multirobot teams. 

Abstract Mobile robots with manipulation capability are a key technology that enables flexible robotic interactions, large area covering and remote exploration. This paper presents a novel class of actuation-coordinated mobile parallel robots (ACMPRs) that utilize parallel mechanism configurations and perform hybrid moving and manipulation functions through coordinated wheel actuators. The ACMPRs differ with existing mobile manipulators by their unique combination of the mobile wheel actuators and the parallel mechanism topology through prismatic joint connections. Common motion of the wheels will provide mobile function while their relative motion will actuate the parallel manipulation function. This new concept reduces actuation requirement and increases manipulation accuracy and mobile motion stability through coordinated and connected wheel actuators comparing with existing mobile parallel manipulators. The relative wheel location on the base frame also enables a reconfigurable base size with variable moving stability on the ground. The basic concept and general type synthesis are introduced and followed by kinematics and inverse dynamics analysis of a selected three limb ACMPR. A numerical simulation also illustrates the dynamics model and the motion property of the new mobile parallel robot (MPR) followed by a prototype-based experimental validation. The work provides a basis for introducing this new class of robots for potential applications in surveillance, industrial automation, construction, transportation, human assistance, medical applications, and other operations in extreme environment such as nuclear plants, Mars, etc.